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Automatic Identification of the Anterior and Posterior Commissure Landmarks 
Field of the invention 

The present invention is related to methods and apparatus for identifying 
anterior commissure (AC) and/or posterior commissure (PC) landmarks from 
5 an image of a portion of a brain. 

Background of Invention 

Identification of the AC and PC are critical for operations such as targeting 
stereotactic and functional. neurosurgery, localisation, analysis in human brain 
10 mapping, structure segmentation and labelling in neuroradiology. The 
Talairach atlas has been widely used as a common standard by 
neuroscientists aiid neurosurgeons. To perform spatial normalisation using 
either standard or modified Talairach transformations, the MSP (midsagittal 
plane), AC and PC have to be identified. 

15 

Currently experts perform the detection of these structures manually. 
However, observer reproducibility is less accurate and prohibitively time- 
consuming when large sets of data have to be analysed. Furthermore, there is 
a certain degree of variability among different experts in tracing these 
20 landmarks, 'for these reasons, there is a need to automate the process of 
identification with accurate, robust and efficient algorithms. 

Sun Y. H. et al, in the article "Anatomic labelling of PET brain images with 
automatic detection of AC and PC", J. Digit Imaging, 1998 Aug; 11 (3 Suppl 
25 1):56-58, describe an automatic detection method for finding the AC and PC 
from positron emission tomography (PET) brain images. However, the 
resolution of PET images is very low, and the AC and PC are particularly 



WO 2005/048844 



PCT/SG2004/000361 



2 

difficult to identify in such images. Thus, the algorithm is only able to identify 
the AC and PC with a high level of uncertainty. 

Verard L. et al., in the article "Fully Automatic Identification of AC and PC 
5 landmarks on Brain MRI using scene analysis", IEE Trans Ml, 16(5), 610:616, 
1997, describe a method for automatically finding the AC and PC which 
assumes that high resolution magnetic resonance imaging (MRI) images are 
available. An automatic algorithm uses the data to estimate the MSP. In a first 
stage, two easily detectable structures - the corpus callosum (CC) and brain 
10 stem (BS) - are identified using intensity-based recognition. From these, a 
small structure - the superior colliculus (Co) - is detected. The PC is obtained 
from the resultant locations using template matching. The position of the AC 
is then found by a further template matching step. This method suffers from a 
number of disadvantages, one of which is the need for the high resolution 
15 images. 

Summary of the Invention 

The present invention aims . to provide a new and useful method for 
identification of the AC and/or PC landmarks. In particular, the invention aims 
20 to make it possible to provide a fast, accurate, robust and clinically practical 
algorithm. 

A first aspect of the invention proposes, in general terms, that the AC and/or 
PC landmarks are found by firstly identifying structures in the brain 
(specifically the fornix and/or brainstem) as groups of pixels in an MRI image 
25 which have an intensity in ranges defined by one or more thresholds and 
which obey predefined geometrical criteria. The thresholds are varied until the 
predefined geometrical criteria are met. The positions of the AC and PC are 
then estimated based on the identified structures. 
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A second aspect of the invention proposes, in general terms, that estimates of 
the positions of the AC and/or PC landmarks are first found using an 
midsagittat MRl image, but that these estimates are modified using axial 
and/or coronal MRl images in planes including, and/or proximate to, the 
5 estimated positions of the AC and/or PC landmarks. 

A specific expression of the first aspect of the invention is a method of 
estimating the position of a brain landmark which includes: 

(i) defining at least one initial threshold value; 

(ii) determining whether a region of a midsagittal radiological image 
10 including a brain structure includes a group of pixels having intensity values in 

a range defined by the initial threshold value and which obey one or more 
predefined geometrical criteria describing the structure; . 

(iii) if not, then at least once modifying the threshold value and 
performing step (ii) again; 

1 5 (iv) if so, identifying the group of identified pixels as the structure; and 

(v) generating a first estimate of the position of the landmark as a point 
on the identified structure. 

A second expression of the invention is a method of estimating the position of 
the AC and/or PC landmarks which includes: 

20 (a) using a midsagittal radiological image to estimate the position of the 

AC and/or PC landmarks in the midsagittal plane; 

(b) using the estimated position of the AC and/or PC landmarks to 
generate one or more axial and/or coronal MRl images, including at least one 
image including the estimated position of the AC and/or PC landmarks; and 
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(c) analysing the axial and/or coronal MRI Images to improve the 
estimate of the position of the AC and/or PC landmarks. 

Either, or both, of the methods may be supplemented by a step of generating 
a sub-image from the midsagittal MRI image including the first estimated 
5 position of the AC landmark or PC landmark, and identifying an improved 
estimate of the position of the AC landmark or PC landmark from the intensity 
values in that sub-image. 

The two aspects of the invention are independent, but may be freely 
combined, as discussed below. 

10 In the following detailed description of examples of the invention the term AC 
landmark and PC landmark are for conciseness referred to simply as the AC 
and PC respectively. 

Brief Description of The Figures 

Preferred features of the invention will now be described, for the sake of 
1 5 illustration only, with reference to the following figures in which: 
Fig. 1 is the midsagittal MRI image of a brain; 
Fig. 2 is a binarised version of Fig. 1; 
Fig 3 is an enlarged view of a part of Fig. 2; 
Fig. 4 is an enlarged view of a part of Fig. 1 ; 
20 Fig. 5 shows steps of the first part of a method which is an embodiment 

of the invention; 

Fig. 6, which is composed of Figs. 6(a) and 6(b), shows a binarised 
version of a first MRI image of the CC, and a horizontal projection of this 
image; 

25 Fig. 7, which is composed of Figs. 7(a) and 7(b), shows a binarised 

version of a second MRI image of the CC, and a horizontal projection of this 
image; 
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Fig. 8 is a portion of Fig. 1 with the fornix highlighted; 
Fig. 9 is a portion of Fig. 1 with the brainstem highlighted; 
Fig. 10 is a portion of the MRI image including an estimate of the 
position of the AC; 

5 Fig. 1 1 is a portion of the MRI image including an estimate of the 

position of the PC ; 

Fig. 1 2 shows a process carried out on the image of Fig. 1 1 ; 
Fig. 13 is steps of a process for improving initial estimates of the 
positions of the AC and PC in the method which is an embodiment of the 
10 invention; 

Fig. 14 shows steps of a further process for improving initial estimates 
of the positions of the AC and PC in the method which is an embodiment of 
the invention; 

Fig. 15 shows 5 axial MRI images derived using an estimate of the 
1 5 position of the AC. 

Fig. 16, which is composed of Fig. 16(a) to 16(d), shows a process 
applied to one of the images of Fig. 15; 

Fig. 1 7 shows a further step of a process using the images of Fig. 15; 
Fig. 18 which is composed of Fig. 18 (a) to Fig. 18(d), shows a process 
20 applied to one of the PC axial images (of the 5 slices) obtained using initial 
estimate of the position of the PC; 

Fig. 1 9 shows a further step of a process using the images of Fig. 15; 
Fig. 20 shows steps of a further process for improving initial estimates 
of the positions of the AC and PC in the method which is an embodiment of 
25 the invention; 

Fig. 21 shows 5 coronal MRI images derived using an estimate of the 
position of the AC; 

Fig. 22 shows 5 coronal MRI images derived using an estimate of the 
position of the PC; 
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Fig. 23 shows a symmetry line imposed on a part of the images of Fig. 

21. 

Fig. 24 shows intensity values along a symmetry line shown in Fig. 23; 
Fig. 25 shows a symmetry line imposed on a part of the images of Fig. 
5 22; and 

Fig. 26 shows intensity values along a symmetry line shown in Fig. 25. 

Detailed Description of the embodiments 

10 Steps in a method which is an embodiment of the invention are now 

described. The starting point of the method is a radiological image such as the 
MRI image shown in Fig. 1 . The MRI image is assumed to be oriented 
according to the radiological convention i.e. with the subject's nose pointing 
left and his or her neck towards bottom of the image. 

15 

The MRI image is an MSP image, meaning that it represents data lying in an 
estimated mid-sagittal plane. The equation of the MSP can be obtained 
according to any known estimation algorithm, such as the one described in 
WO 03/60827 (based on PCT/SG02/00006). However, the invention is not 
20 limited to this method of obtaining the MSP. 

A first step of the method is to use progressive thresholding to binarise the 
image. This is illustrated in Figs. 2 to 3. The method is carried out by the 
following steps, which are illustrated in Fig. 5: 

25 

a) A window of size 1 1 X 1 1 is moved over the entire image of Fig. 1 in an 
overlapping manner and the mean value of the pixels in the window at every 
location is recorded. 

b) The maximum among the means derived in step (a) recorded is 
30 computed. 
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c) An initial threshold is fixed as 80% of the maximum mean (step 1 in 
Fig. 5). 

d) A binary image is derived from Fig. 1 in which each pixel above the 
initial threshold is set to white, and each pixel below the threshold is set to 

5 black (this is step 2 in Fig. 5, and the result is shown in Fig. 2). 

In the binary image, an attempt is made (step 3) to identify the Corpus 
Callosum (CC) as the structure having the following properties (based on the 
observations and validation of data): 

10 

a) The length of the CC (from the genu to the splenium, i.e. along the major 
axis) is about 7 to 9 cm. 

b) The width of the CC (from the superior point of body or trunk to the inferior 
point of the genu, i.e. the minor axis) is about 2 to 4 cm. 

15 c) The orientation of the CC (angle of major axis with respect to horizontal 
axis) is from 5 to 40 degrees. 

d) The area of the CC in the binarised image is about 600 to 1000 mm 2 . 

If such a structure is not identified, then it is determined whether the threshold 
20 is less than 40% of the initial value, and if not the threshold is reduced by 10% 
of its current value (step 4), and steps 2 and 3 are repeated. 

Steps 2 to 4 are repeated until the CC is detected or the threshold value is 
less than 40% of the initial value. If the threshold value is less than 40 % of 
25 initial value and CC is not found, the program quits, stating that CC is not 
found. 

For example, if the starting image is Fig. 1 , then a CC will be identified by this 
procedure. It is shown in Fig. 3. The major axis is marked (as the line LA-RA), 
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as fs the minor axis. The points marked RB and LB are the right bottom and 
left bottom parts. 

More generally, if the CC is found, the method proceeds to step 5 in which a 
check is carried out to determine whether the CC and fornix are attached: 

a) Define a subregion (S1 ) around CC. Fig. 4 shows this area for the case 
that the initial MSP image is as in Fig. 1 . The height of the sub-region is 
selected in such a way that the brainstem (BS) and fornix are included. 
Specifically, the width of the region S1 is selected to be equal to the major 
axis, and the height was set to 2.5 times the minor axis. 

b) For each column in the binary image of S1 , the horizontal projection of 
the columns (i.e. for each row, the sum of the values in that row) is calculated. 

Figs. 6 and 7 show two cases. Figs. 6(a) and 7(a) show the binary image of 
15 the region S1 for two different initial MRI images, and Figs. 6(b) and 7(b) 
show the corresponding projections. 

If there are 3 peaks, or if the centre point of the projection is higher than the 
mean of the two end points, as in the case of Fig. 7(b), then the fornix and CC 
20 are attached together. 

If the fornix is separated from the CC, the method passes to the set of steps 
shown in Fig. 13. Otherwise, prior to doing this, a step 6 is carried out in which 
the CC and fornix are separated by boundary tracing and morphological 
25 operations. 

In a first of the steps of Fig. 13 (step 7) the fornix is identified as follows. 

a) Within the sub-region S1 , a region of interest (ROI) for fornix detection 
30 is defined. Fig. 8 shows the sub-region S1 , with the parts of S1 which are not 
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within the ROI shown as black. The ROI is defined as the region between 
20% and 80% of CC's major axis. The CC structure is subtracted from the 
ROi. 

5 b) The ROI region is binarised using a progressive thresholding algorithm, 
resembling the one used above. In this case, pixels are set to white or black 
according to whether the corresponding value of the MRI image is above or 
below an initial threshold, and the threshold gradually reduced until a fornix 
structure can identified in the image. The fornix is identified as a structure in 

10 the ROI having the following properties. 

i) It is elongated white matter structure 

ii) It is located in between the two ends of CC. 

Hi) It has an orientation > Sdegrees & < 90 degrees. 
. iv) It has a major-axis to minor-axis ratio > 2. 

15 

The entire fornix structure may be not be seen by thresholding, hence to get 
the complete structure of fornix we do region growing. The intensity values of 
pixels which are expected to be in the identified fornix structure region are 
collected and their mean value is computed. From this mean value, two 

20 thresholds for region growing of the fornix are calculated. This process 

involves defining a parameter Mf which is the mean of the pixel intensities in 
the possible fornix region, and a second parameter a which is the standard 
deviation of the intensity values in the same region. Then a lower threshold L f 
is defined as Mf-2ct , and an upper threshold Uf is defined as Mf+2ct . Using 

25 these thresholds the full fornix region is obtained by "region growing" as 
shown in Fig. 8. In this process the pixel values of all regions between the 
thresholds are assumed to be part of the fornix. The inferior most tip of the 
fornix is identified as a first estimate of position of the AC (step 8). 
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Once fornix region, is identified, CC and fornix structures are subtracted from 
the subregion S1 . The result is the region of SI which is not black in Fig. 9 
The brainstem (BS) is identified in this region using anatomical information, 
that BS is located inferio-posterioriy to CC. The BS is composed of grey and 

5 white matter pixels, having higher variance in intensity values than in CC and 
fornix. Similar to fornix identification, we initially detect the possible BS region 
using thresholding and perform region growing to extract complete structure. 
The BS region is characterized by the location of a centroid, intensity variation 
and width of the region. The lower and upper limits for region growing using 8- 

10 neighborhood were calculated as by defining a first parameter MBS which is 
the mean of the pixel intensities in the possible BS region, and a second 
parameter a which is the standard deviation of the pixel intensities in the 
possible BS region a . Using these two parameters, we set a lower threshold 
Lbs which is MBS - 3ct, and an upper threshold U B s which is MBS+2cr . All 

1 5 pixels for which the values of the MRl image are between these thresholds 
are assumed to be part of the BS. The values of the thresholds given above 
are proposed based on the composition of grey and white matter pixels in BS. 
Our observation from the data showed a larger deviation of grey values to the 
lower side of the mean than to the upper side. 

20 

For the MRl image of Fig. 1 , this gives the estimate for the BS as the points 
shown in white in Fig. 9 (step 9). The upper right most point of BS is defined 
as our initial estimate of the PC point (step 10). 

25 A next step is to obtain an improved estimate of the positions of the AC and 
PC- To do this, we generate two sub-images of the initial MRl image (step 
11). For the MRl image of Fig, 1, these sub-images are shown in Figs. 10 and 
1 1 respectively. The sub-images are selected as ROls respectively around 
the initial estimates of the positions of the AC and PC. The AC sub-image 

30 (Fig. 1 0) is centered at the initial estimate of the position of the AC , and has a 
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size large enough (e.g. 12X12 mm, which are values which selected based 
on the observations and anatomy) to include surrounding structures for 
processing. The construction of PC sub-image is based on variability 
information that the PC is situated at a distance of 1 7- 42 mm posterior to the 

5 AC. The initial estimate of the PC derived above was checked, to see it obeys 
the above condition, and if so an area large enough (eg. 16 X 16 mm) to 
include this point and surrounding structures was defined as PC image. If the 
condition is not met, the BS region growing is carried out with new thresholds 
and a re-estimate the initial position of the PC. For all the cases for which we 

10 have tested our algorithm, the initial position of the PC obeyed the condition. 

The position of the AC is below the inferior tip of fornix, but due to partial 
volume or imaging artifacts the AC is indistinguishable from the inferior tip of 
fornix. The AC will usually be manifested as a bright point in the AC image, 

15 which can be located by binarising the image and region growing the 
foreground pixels. An improved estimate of the position of the AC is the 
inferior-most point of the largest region in the AC sub-image. Around this 
initial position of the AC we check to see if there are any points with a higher 
intensity. If such a point is found, it is considered as an improved estimate of 

20 the position of the AC. Otherwise, the previous estimate of the AC point itself 
is retained (step 1 2). 

An improved estimate of position of the PC is obtained by performing a 
horizontal projection of the PC image (step 1 3). In other words, for each row 

25 of the PC sub-image we find the respective sum of the corresponding MRI 

intensities. The resultant plot is shown in Fig. 12(b). The PC image contains a 
part of the brainstem and the superior colliculus. The point where, the slope 
changes significantly indicates the row of PC image containing the position of 
the PC, at least for cases where the superior colliculus is well separated from 

30 BS. This row is designated as an initial estimate of the PC row of the PC sub- 
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image. In cases where the superior colliculus is not separated, the slope 
change is not significant. Hence, two adjacent rows of the identified PC_j*ow, 
in the PC image are also considered for final refinement. The PC is identified 
as the point having the maximum change in grey value with the neighbour 
5 pixels in the identified PCjrow and its adjacent rows. After identifying the PC 
row, the intensity profile along the rows is taken, as shown in Fig. 12(a), and 
the column number of the PC in the image is found using Fig. 12(a), as the 
maximum intensity along the PC row. 

10 The final coordinates of the positions of the AC and PC are mapped back to 
the volume data using the MSP equation. The corresponding axial slices 
where the AC and PC are manifested are identified using the MSP equation, 
voxel size and the volume dimensions. 

15 Fig. 14 shows the steps of an optional technique for improving the estimates 
of the estimates of the positions of the AC and PC derived above by 
processing axial slices. 

In a first step (step 14), the axial slices containing the positions of the AC and 
20 PC estimated above are found by using the coordinates of the estimated 

positions of the AC and PC in the midsagittal plane and MSP equation. These 
two axial slices are termed "reference slices". 

In a second step (step 15), for each of these AC and PC axial slices, five 
25 further slices are defined: two slices above each of the AC and PC axial 

slices, and two slices below each of the AC and PC axial slices. The resultant 
five slices derived from the AC reference slice are shown in Fig. 1 5. 

In a third step (step 16), for the AC reference slice and each of the four slices 
30 derived from it, we form a mean ventricular line (MVL) passing through the 
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third ventricle, by using the horizontal and vertical projections of the 
corresponding slice. This is shown in Fig. 16, where a slice (shown in Fig. 
16(a)) is used to produce a horizontal projection (shown in Fig. 16(c)) and a 
binary version of the slice (shown in Fig. 16(b)) is used to produce a vertical 
5 projection (shown in Fig. 1 6(d)). The binary version of the slice is produced 
using a threshold which is selected to be 70% of the region of the mean 
intensity of the region-of-interest, and pixels below this threshold are shown in 
Fig. 16(b) as white, and pixels above the threshold as black. 

10 Using the MVL profile, a set of evaluations is performed checking: 

1. whether Massa Intermedia is present or the third ventricle is complete, and 

2. whether there is a cistern before the AC or the slice has gray matter. 
To evaluate the first condition, check along the MVL for continuity of white 
pixels in the binary image. If the continuity or the length of white pixels is at 

15 least 85% of the distance between AC and PC then there is no Massa 
Intermedia present. If the continuity is broken then Massa Intermedia is 
present. The distance between the AC and PC is found by the initial estimates 
of the positions of the AC and PC. The second condition is evaluated by 
checking the MVL profile before an initial position of the AC. If there are CSF 

20 intensity pixels, it is assumed that a cistern is present; else if the pixel 

intensity is of gray matter then a gray matter is present. These conditions are 
necessary to decide on what will be the nature of a profile along the MVL and 
it is used as a reference while searching for the AC and PC. 

25 In a fourth step, we examine the profile plot of image values along the MVL 
(shown in Fig. 1 7). That is, starting from the midpoint of the profile (i.e. a point 
in the third ventricle or on the Massa intermedia) we move leftwards to locate 
a WM (white matter) peak. This peak is the one end point of the AC. Following 
the peak, we use the second derivative of the profile to identify the starting 

30 point of the AC. Similarly we find the start and end points in all the 5 other 
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slices considered for processing. The AC is assumed to have a width of 
about 3 mm. Using, these starting and end points and the value of intensity in 
between these points, region growing is carried out to extract the complete 
structure of AC (step 17). 

5 

To form an improved estimate of the position of the PC (step 18), we use the 
MVL profile plot for the PC reference slice, and the four axial slices around the 
PC reference slice. This is shown, for one of those five axial slices, in Fig. 18. 
Fig. 18(a) shows one of the axial slices, Fig. 18(c) shows a horizontal 

10 projection of it (i.e. summing the values in respective rows), Fig. 18(b) shows 
a binarised version of it (produced in the same way as Fig 16(b) described 
above), and Fig. 18(d) shows a vertical projection of the binarised version (i.e. 
summing the values in respective columns). This is performed in the same 
manner as how the MVL is obtained for AC slices. Fig. 19 shows the intensity 

15 profile along the MVL. Starting from the middle of the profile and moving 
towards the right side of the plot, we trace the PC. Since the third ventricle 
has a cerebro spinal fluid (CSF) which manifests itself as dark matter, the WM 
peak is identified as the PC location. As in AC identification, the PC too is 
identified using region growing, as a structure which is cylindrical in shape 

20 and having radius of about 1mm. 

Fig. 20 shows the steps of a corresponding technique for improving the 
estimates of the positions of the AC and PC derived above by processing 
. coronal slices. 

25 

From the coordinates of the structures (AC & PC) the corresponding coronal 
reference slices are identified (step 20). 

For each of the AC and PC coronal reference slices, two further slices in the 
30 anterior direction and two further slices in the posterior direction are defined. 
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Thus, there are a total of 5 slices for the AC, and 5 slices for PC (step 21 ). 
The five slices for the AC are shown in Fig. 21 , and the five slices for the PC 
are shown in Fig. 22. 

5 For all the five slices selected a region of interest is selected, consisting of 
CC, lateral ventricle and AC is selected using the MSP equation. A binarised 
version of each slice is formed, and the binarised ROls are used to locate the 
symmetrical line This is the white line on Fig. 23. The AC and PC are 
assumed to be on this symmetrical line. 

10 

Using the intensity information of CC, a rough estimate of intensity of the AC 
is obtained as both CC and AC are white matter structures and CC is more 
homogeneous structure. 

15 • The intensity value along the symmetry line (shown in Fig. 24) is scanned 
(step 22) to obtain a white matter peak in the opposite direction of CC. This 
point is considered as a good estimate for the position of the AC if it has 
intensity close to white matter intensity and third ventricle can be identified 
after the AC (low gray value due to CSF). 

20 

The further slices around AC reference slice are checked for the above 
condition. The slices which meet the above conditions are considered to have 
the AC and from this the radius of the AC is found out (step 23). 

25 From the PC slices, the ROI around the MSP line is extracted to find the 

symmetrical line passing through the ROI (the white line on Fig. 25). The PC 
is assumed to be on the symmetry line. The location of the CC is known from 
earlier processing, and hence can be used as a reference to locate white 
matter structures. The symmetry line (shown in Fig. 26) is scanned (step 24) 
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to locate the CC and find its intensity value. The intensity value of CC is used 
as a reference to locate the PC as follows. 

A scan is done along the symmetry line away from CC position. The CSF 
5 region separates the CC and PC. Hence the intensity values will be low in this 
region. After the CSF region, a small region of pixels of white matter and gray 
matter mix can be located. After this point, a few pixels of low intensity 
corresponding to CSF are located which represents the aqueduct. The PC is 
the region between the CSF matter and the aqueduct. 

10 

The above conditions are checked in the PC coronal slices considered for 
processing. The slices which satisfy the conditions are marked as possessing 
PC. From the number of slices having the PC the dimensions of the PC 
structure is found out (step 25). 

15 

The final positions of the AC and PC are found using the information obtained 
from ail the three orientations. This is the best position estimate found above 
in each of the three directions. 

20 Using the final positions of AC and PC, 3D extraction of the AC and PC is 
carried out. The PC is assumed to be cylindrical with diameter of about 2mm. 
The AC is assumed to be a bent cylinder with diameter about 3mm. This is 
based on anatomical knowledge. Primarily we are interested in determining 
the width of the AC and PC, rather than their height (i.e. length in axial slices). 

25 

Although only a single embodiment of the invention has been described in 
detail, many variations are possible within the scope of the invention as will be 
clear to a skilled reader. 



